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Abstract. The possibility of simulating a stochastic process by the intrinsic 
randomness of quantum system is investigated. Two simulations of Markov 
Chains by the measurements of quantum systems are proposed. 

1 Introduction 

Stochastic simulation methods, also commonly known as Monte Carlo methods, 
are important in scientific computing. Such methods are useful for studying 
deterministic problems that are too complicated to model analytically or de- 
terministic problems whose high dimensionality makes standard discretizations 
infeasible. Stochastic simulations [1] are usually realized by classical computer 
algorithms, which are actually deterministic. In this paper, we study the possi- 
bility of simulating a stochastic process by the intrinsic randomness of quantum 
system. We believe that, theoretically speaking, a quantum system may sim- 
ulate a stochastic process better than a classical system due to its intrinsic 
randomness. 

Markov Chain is a basic and widely studied stochastic process. It is also 
useful in scientific computing. For example, one can solve partial differential 
equations or groups of linear equations by simulations of Markov Chains. In this 
paper we will propose two simulations of Markov Chains by the measurements 
of quantum systems. The second simulation is closely related to the reading of 
a quantum register and thus may be realized by quantum computer. It thus 
seems that quantum computer might be a better choice than classical computer 
for carrying out Monte Carlo method. 

2 Definition of Markov Chain 

In probability theory, the concept of experiment occupies a crucial position. 
Roughly speaking, an experiment consists of a space of its possible outcomes, 
together with an assignment of probabilities to each of these outcomes. In 
this paper, we only consider experiments with finitely many outcomes. Let 
/ be a finite set. The formal definition of an experiment (with finitely many 
outcomes) is as follows [2]. 

Definition 1. A function A : / [0,1] is called a distribution on / if 
M'i') — 1- When A is a distribution on / it will be denoted by A = (Ai : i £ 
I) where Xi A(i). 
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Definition 2. An experiment _E is a pair {Q,p) where fl = {u!i\i G /} is a 
finite set of the outcomes of E, called the sample space of E, and p= {pi : i G I) 
is a distribution on /, called the distribution of E, where pi = p{ijOi). 

Another ingredient necessary for the definition of Markov Chain is the con- 
cept of stochastic matrix. 

Definition 3. A matrix P = {pij)i,j^i is called stochastic if for each i G 7 
= [pij : j S /) is a distribution on /. 

Now let us introduce the definition of Markov Chain. 

Definition 4. Let P = {Pij)i,j£i be a stochastic matrix. A (finite or infinite 

sequence) of experiments {En)n>a is called a Markov Chain with the transition 
matrix P if all the experiments in the sequence have the same sample space 
fl = {uJi\i € /} and for each n > the distribution of the experiment En+i only 
depends on the outcome of the experiment i?„ in the following way: when the 
outcome of En is Ui the distribution of En+i is = (pij : j € /). 

Prom probability point of view, the behavior of a Markov Chain {En)n>o 
is completely determined by its transition matrix and its initial distribution, 
namely, the distribution of the experiment Eq. 

Remark. The above definition of Markov Chain might not be formal or 
rigorous enough from mathematical point of view. But for our modest purpose 
in this paper Definition 4 is adequate. For the definition of Markov Chain based 
on the terminology of probability space and conditional probability [3], which is 
mathematically beyond question, the reader who has a passion for mathematical 
rigorousness and preciseness can refer to mathematical text books on probability 
theory. 

3 Simulation of Markov Chains by Angular Mo- 
mentum System 

In this section we will propose a realization of Markov Chains by a sequence of 

quantum measurements for angular momcntums. 

Consider a spin s system §. Let S^, Sy and Sz be the y and z components 
of the spin operator S of §. 

Let R be the operator of a rotation through an angle about a direction 
specified by the unit vector n. Then we have R = e~*^"'^, which is clearly 
unitary. Suppose that this rotation is specified by the Eulerian angles (a, p, 7), 
then by definition it can bo carried out in three stages: (1) a rotation through 
the angle a (0 < a < 27r) about the z-axis, (2) a rotation through the angle 
/? (0 < /3 < tt) about the new position y' of the y-axis, (3) a rotation through 
the angle 7 (0 < 7 < 2it) about the resulting final position z" of the ^;-axis. 
Correspondingly, we have 

Jl — g-iSn-S _ ^-i'^S^ii ^-ifiSyi ^-iolSz _ ^-iaSz ^-ifiSy ^-i'^Sz ^ 

Now define S'„ = R^iS^R- Physically, it represents the component of the 
spin operator S in the direction specified by the vector n. Let {|sm)|m = 
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s, s^l, ■ ■ ■ , — s} be the state vectors of the spin system § that span the standard 
2s + 1 dimensional irreducible representation space of the Lie algebra generated 
by the spin operators S^, Sy and Sz. To be precise, we have 

S^jsm) — s{s + l)\sm), Sz\sm) = m\sm). 

Let \sm') = R~^\sm) for each m. Then we have 

(sm'slsmi) = (sm2|e-^"'^^e-''''*''e-'T''^»|smi) =e-*"="(sm2|e-''^^''|smi)e-''"^T'. 
Denoting this quantity by -D^^^^ (a, /3, 7), we have 

where 

Similarly, it is easy to check that 

{sm2\sm',) = D^,„,(a,/3,7) = e^"'^"d^,„,(/3)e'-=^ 

where the "overline" means taking complex conjugation. But it can be proved 
that 

it thus follows that 

\{sm'2\smi)\^ = \{sm2\sm[)f = \dtn^^Al^)\^ ■ 

Notice that when the system S is in the state \sm') and a measurement of Sz 
is carried out then | (sto2 Istoj) |^ is exactly the probability that the measurement 
will give the value m2- Likewise, when the system § is in the state \sm) and a 
measurement of S^i is carried out then |(,sm2|sTOi)| is exactly the probability 
that the measurement will give the value m2- That these two probabilities are 
identical, as shown above, prompts us to propose the following realization of 
Markov Chains by the proper measurements on the system §. 

Denote by M and M' respectively the measurements of Sz and S^ on the 
system §. Let us consider the sequence {Mn)n>a of measurements, where M„ 
stands for M when n is even and stands for M' when n is odd. We observe that 
each Mn can naturally be regarded as an experiment in the sense of Definition 
2, with the sample space il = {s, s — 1, • ■ • , — s} = /, which is independent of 
n. On the other hand, the distribution of M„+i only depends on the outcome 
of Mn in the following way: when the outcome of M„ is mi, the distribution of 
Mn+i is p™i = (Mmami • '"'2 "= The reason is, if the measurement M 
or M' gives the value mi, then the system will collapse to the state \sm\) or 
\sm'i) after the measurement. 

Now it should be clear that the above defined the sequence (M„)„>o of 
measurements can be regarded as a simulation of the Markov Chain with the 
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transition matrix {pij)i.jei where pij = |(i|j(/3)p. If the system S is initially in 
the state \tp), then this Markov Chain has the initial distribution {(sm|'0)p : 
m e /}. 

An interesting case arise when wc take s — 1/2, /3 = 7r/2 and a = 7 = 0. In 
this case Sn = Sx and the sample space of M„ is {1/2,-1/2}. Moreover, we 
have 

l4/'m.(V2)P = 1/2, Vmi,m2 e {1/2,-1/2}. 

Thus the sequence (Af„)„>o can be regarded as a simulation of the coin tossing 
experiment and the system S may be used as a random numbers generator. 

4 Simulation of Markov Chains by q-Bit System 

Essentially based on the idea of the last section we propose in this section a 
simulation of Markov Chains by q-bit system. 

Wc model a q-bit as a spin 1/2 system § and keep the same notation for 
the system § as in the last section. Let us consider the q-bit system Qjv that 
is composed of A'' independent q-bits. Denote by S' the angular momentum 
operator of the ith q-bit and by J the angular momentum operator of the q-bit 
system Qjv- As in the last section we define Jn = R^JzR- By definition we have 

Af N 
i=l i=l 

Now consider the measurement of carried out by measuring each SI and 
the measurement of Jn carried out by measuring each S^. We denote these two 
kinds of measurement by M and M' respectively. 

For convenience, we introduce the state vectors |+), |— ), |+n) and |— „) as 
follows: 

Then, from the general formula for the matrix clement (i^^nij (/?) wc have 

|(+„|+)|2 = |(+|+„)|2| = |cos/3/2|^ K-„|+)|2 = = |sin/3/2|2 

and 

|(+„|-)|2 = = |sin/3/2p, |(-„|-)r = l(-|-n)P = |cos/3/2|^ 

According to the theory of quantum measurement, after the measurement M 
each q-bit is either in the state |-|-) or in the state |— ) and after the measurement 
M' each q-bit is either in the state |-|-„) or in the state |— „)• Thus, after the 
measurement M, if its outcome is j, then N/2 + j q-bits of the system 
collapse to the state |+) and the other A''/2 — j q-bits collapse to the state |— ). 
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Denote by qjij the probability that the measurement M' on the system Qj^ 
which has just experienced the measurement M that gives the value j, will give 
the value j'. It then follows that if j > j' 

N/2—j' 

and if j < j' 

N/2-\-j' 
m=j'-j 

Moreover, it is easily check that qjrj is also the probability that the measurement 
M on the system Qjv which has just experienced the measurement M' that gives 
the value j, will give the value j'. It should then be clear that the sequence 
{Mn)n>o of measurements, where M„ stands for M when n is even and stands 
for M' when n is odd, can be regarded as a simulation of the Markov Chain 
with the transition matrix {qj'j)-N/2<j',j<N/2- 
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